Search results for "Transfer entropy"

showing 10 items of 44 documents

Measuring spectrally-resolved information transfer.

2020

Information transfer, measured by transfer entropy, is a key component of distributed computation. It is therefore important to understand the pattern of information transfer in order to unravel the distributed computational algorithms of a system. Since in many natural systems distributed computation is thought to rely on rhythmic processes a frequency resolved measure of information transfer is highly desirable. Here, we present a novel algorithm, and its efficient implementation, to identify separately frequencies sending and receiving information in a network. Our approach relies on the invertible maximum overlap discrete wavelet transform (MODWT) for the creation of surrogate data in t…

0301 basic medicineDiscrete wavelet transformInformation transferComputer scienceEntropyInformation Theory0302 clinical medicineWaveletMathematical and Statistical TechniquesMedicine and Health SciencesBiology (General)Wavelet TransformsTemporal cortexMammalsEcologySystems BiologyApplied MathematicsSimulation and ModelingPhysicsWavelet transformMagnetoencephalographyEukaryotaBrainSignal FilteringComputational Theory and MathematicsModeling and SimulationPhysical SciencesVertebratesThermodynamicsEngineering and TechnologyWavelet transforms ; Algorithms ; Magnetoencephalography ; Information entropy ; Signal filtering ; Ferrets ; Permutation ; EntropyAnatomyAlgorithmInformation EntropyAlgorithmsResearch ArticleComputer and Information SciencesQH301-705.5PermutationWavelet AnalysisPrefrontal CortexResearch and Analysis Methods03 medical and health sciencesCellular and Molecular NeuroscienceGeneticsEntropy (information theory)AnimalsHumansInformation flow (information theory)Molecular BiologyEcology Evolution Behavior and SystematicsDiscrete MathematicsFerretsOrganismsBiology and Life Sciences030104 developmental biologyCombinatoricsSignal ProcessingAmniotesTransfer entropyZoologyMathematical Functions030217 neurology & neurosurgeryMathematicsPLoS computational biology
researchProduct

Redundant and synergistic information transfer in cardiovascular and cardiorespiratory variability

2015

In the framework of information dynamics, new tools are emerging which allow one to quantify how the information provided by two source processes about a target process results from the contribution of each source and from the interaction between the sources. We present the first implementation of these tools in the assessment of short-term cardiovascular and cardiorespiratory variability, by introducing two strategies for the decomposition of the information transferred to heart period (HP) variability from systolic arterial pressure (SAP) and respiration flow (RF) variability. Several measures based on the notion of transfer entropy (TE) are defined to quantify joint, individual and redun…

AdultMaleInformation transferComputer scienceEntropyBiomedical EngineeringBlood PressureHealth Informaticscomputer.software_genreCardiovascular Physiological PhenomenaElectrocardiographyHeart RateHumansPaced breathingSimulation1707Motor NeuronsRespirationModels CardiovascularHealthy subjectsHeartCardiorespiratory fitnessHealthy VolunteersSignal ProcessingSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaSystolic arterial pressureFemaleTransfer entropyData miningcomputer
researchProduct

Instantaneous transfer entropy for the study of cardio-respiratory dynamics

2015

Measures of transfer entropy have been proposed to quantify the directional coupling and strength between two complex physiological variables. Particular attention has been given to nonlinear interactions within cardiovascular and respiratory dynamics as influenced by the autonomic nervous system. However, standard transfer entropy estimates have shown major limitations in dealing with issues concerning stochastic system modeling, limited observations in time, and the assumption of stationarity of the considered physiological variables. Moreover, standard estimates are unable to track time-varying changes in nonlinear coupling with high resolution in time. Here, we propose a novel definitio…

AdultMaleInformation transferComputer scienceEntropyPostureBiomedical EngineeringProbability density functionHealth InformaticsMaximum entropy spectral estimationNonlinear DynamicEntropy (classical thermodynamics)ElectrocardiographyTheoreticalRespiratory RateControl theoryModelsHeart RateTilt-Table TestEntropy (information theory)Humans1707; Signal Processing; Biomedical Engineering; Health InformaticsStatistical physicsEntropy (energy dispersal)Entropy (arrow of time)1707Likelihood FunctionsEntropy (statistical thermodynamics)Models TheoreticalLikelihood FunctionNonlinear systemDiscrete time and continuous timeNonlinear DynamicsSignal ProcessingSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaTransfer entropyFemaleAdult; Electrocardiography; Entropy; Female; Heart Rate; Humans; Likelihood Functions; Male; Models Theoretical; Nonlinear Dynamics; Posture; Tilt-Table Test; Respiratory Rate; Signal Processing; Biomedical Engineering; 1707; Health InformaticsEntropy (order and disorder)Human
researchProduct

An Information-Theoretic Framework to Map the Spatiotemporal Dynamics of the Scalp Electroencephalogram

2016

We present the first application of the emerging framework of information dynamics to the characterization of the electroencephalography (EEG) activity. The framework provides entropy-based measures of information storage (self entropy, SE) and information transfer (joint transfer entropy (TE) and partial TE), which are applied here to detect complex dynamics of individual EEG sensors and causal interactions between different sensors. The measures are implemented according to a model-free and fully multivariate formulation of the framework, allowing the detection of nonlinear dynamics and direct links. Moreover, to deal with the issue of volume conduction, a compensation for instantaneous e…

AdultMaleInformation transferEntropyComputation0206 medical engineeringInformation TheoryBiomedical Engineering02 engineering and technologyScalp electroencephalogramElectroencephalographyMachine learningcomputer.software_genreEEG propagationYoung Adult03 medical and health sciences0302 clinical medicinevolume conductionmedicineHumansCausal connectivitytransfer entropy (TE)MathematicsBrain MappingScalpmedicine.diagnostic_testbusiness.industryBrainElectroencephalographySignal Processing Computer-AssistedPattern recognitioncomplex dynamic020601 biomedical engineeringmultivariate time series analysiComplex dynamicsNonlinear systemSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaFemaleentropy estimationTransfer entropyArtificial intelligenceInformation dynamicsbusinesscomputer030217 neurology & neurosurgeryIEEE Transactions on Biomedical Engineering
researchProduct

Instantaneous Transfer Entropy for the Study of Cardiovascular and Cardio-Respiratory Nonstationary Dynamics

2017

Objective: Measures of transfer entropy (TE) quantify the direction and strength of coupling between two complex systems. Standard approaches assume stationarity of the observations, and therefore are unable to track time-varying changes in nonlinear information transfer with high temporal resolution. In this study, we aim to define and validate novel instantaneous measures of TE to provide an improved assessment of complex nonstationary cardiorespiratory interactions. Methods: We here propose a novel instantaneous point-process TE (ipTE) and validate its assessment as applied to cardiovascular and cardiorespiratory dynamics. In particular, heartbeat and respiratory dynamics are characteriz…

AdultMaleInformation transferHistoryHeartbeatDatabases FactualPhysiologyEntropy0206 medical engineeringComplex systemBiomedical EngineeringHeart Rate VariabilityProbability density function02 engineering and technology01 natural sciencesPoint processStatistics NonparametricElectrocardiographyYoung Adult0103 physical sciencesProbability density functionEntropy (information theory)HumansStatistical physicsTransfer Entropy010306 general physicsBiomedical measurementMathematicsbusiness.industryHemodynamicsModels CardiovascularHeart beatSignal Processing Computer-AssistedComplexityBaroreflex020601 biomedical engineeringKolmogorov-Smirnov DistanceRespiratory Sinus ArrhythmiaBaroreflex; Biomedical measurement; Complexity; Entropy; Heart beat; Heart rate variability; Heart Rate Variability; History; Kolmogorov-Smirnov Distance; Physiology; Point Process; Probability density function; Respiratory Sinus Arrhythmia; Transfer Entropy; Biomedical EngineeringDiscrete time and continuous timePoint ProceSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaPoint ProcessTransfer entropyFemaleArtificial intelligencebusiness
researchProduct

Lag-specific transfer entropy as a tool to assess cardiovascular and cardiorespiratory information transfer

2014

In the study of interacting physiological systems, model-free tools for time series analysis are fundamental to provide a proper description of how the coupling among systems arises from the multiple involved regulatory mechanisms. This study presents an approach which evaluates direction, magnitude, and exact timing of the information transfer between two time series belonging to a multivariate dataset. The approach performs a decomposition of the well-known transfer entropy (TE) which achieves 1) identifying, according to a lag-specific information-theoretic formulation of the concept of Granger causality, the set of time lags associated with significant information transfer, and 2) assig…

AdultMaleInformation transferMultivariate statisticsDynamical systems theoryDatabases FactualComputer sciencePhysiologyEntropyBiomedical EngineeringBlood Pressuredynamical systemYoung AdultGranger causalityControl theoryHumansAutonomic nervous systemmultivariate time serieTime seriesmutual informationcardiovascular controlconditional entropy (CE)RespirationModels CardiovascularComputational BiologyHeartMutual informationCausalityNonlinear systemSettore ING-INF/06 - Bioingegneria Elettronica E InformaticaGranger causalityTransfer entropy
researchProduct

Information transfer in QT-RR dynamics: Application to QT-correction

2018

ABSTRACTThe relation between the electrical properties of the heart and the beating rate is essential for the heart functioning. This relation is central when calculating the “corrected QT interval” — an important measure of the risk of potentially lethal arrhythmias. We use the transfer entropy method from information theory to quantitatively study the mutual dynamics of the ventricular action potential duration (the QT interval) and the length of the beat-to-beat (RR) interval. We show that for healthy individuals there is a strong asymmetry in the information transfer: the information flow from RR to QT dominates over the opposite flow (from QT to RR), i.e. QT depends on RR to a larger e…

AdultMaleInformation transfermedicine.medical_specialtyCorrection methodEntropyHeart Ventricles0206 medical engineeringAction Potentialslcsh:Medicine02 engineering and technology030204 cardiovascular system & hematology3121 Internal medicine114 Physical sciencesQT intervalArticleElectrocardiography03 medical and health sciences0302 clinical medicineHeart RateLääketieteen bioteknologia - Medical biotechnologyInternal medicinemedicineHumanslcsh:ScienceAgedMathematicsBeating rateMultidisciplinarylcsh:RSisätaudit - Internal medicineCorrected qtArrhythmias CardiacHeartMiddle Aged020601 biomedical engineeringHealthy individualsCardiologyFemalelcsh:QTransfer entropy3111 Biomedicine030217 neurology & neurosurgeryScientific Reports
researchProduct

Quantifying Net Synergy/Redundancy of Spontaneous Variability Regulation via Predictability and Transfer Entropy Decomposition Frameworks.

2017

Objective: Indexes assessing the balance between redundancy and synergy were hypothesized to be helpful in characterizing cardiovascular control from spontaneous beat-to-beat variations of heart period (HP), systolic arterial pressure (SAP), and respiration (R). Methods: Net redundancy/synergy indexes were derived according to predictability and transfer entropy decomposition strategies via a multivariate linear regression approach. Indexes were tested in two protocols inducing modifications of the cardiovascular regulation via baroreflex loading/unloading (i.e., head-down tilt at −25° and graded head-up tilt at 15°, 30°, 45°, 60°, 75°, and 90°, respectively). The net redundancy/synergy of …

AdultMaleMultivariate statisticsComputer scienceEntropyBiomedical EngineeringBlood Pressurecomputer.software_genreAutonomic Nervous System01 natural sciences010305 fluids & plasmasHead-Down TiltEntropy (classical thermodynamics)ElectrocardiographyYoung AdultHeart RateBayesian multivariate linear regression0103 physical sciencesStatisticshead-down tilt (HDT)Redundancy (engineering)Entropy (information theory)HumansPredictabilityEntropy (energy dispersal)010306 general physicsEntropy (arrow of time)cardiovascular controlModels StatisticalEntropy (statistical thermodynamics)heart rate variabilityUnivariateSignal Processing Computer-AssistedBaroreflexMiddle Agedhead-up tilt (HUT)Settore ING-INF/06 - Bioingegneria Elettronica E InformaticaTransfer entropyFemaleData miningWiener-Granger causalitycomputerEntropy (order and disorder)IEEE transactions on bio-medical engineering
researchProduct

Categorizing the Role of Respiration in Cardiovascular and Cerebrovascular Variability Interactions

2022

Objective: Respiration disturbs cardiovascular and cerebrovascular controls but its role is not fully elucidated. Methods: Respiration can be classified as a confounder if its observation reduces the strength of the causal relationship from source to target. Respiration is a suppressor if the opposite situation holds. We prove that a confounding/suppression (C/S) test can be accomplished by evaluating the sign of net redundancy/synergy balance in the predictability framework based on multivariate autoregressive modelling. In addition, we suggest that, under the hypothesis of Gaussian processes, the C/S test can be given in the transfer entropy decomposition framework as well. Experimental p…

AdultMalePhysiologyBiomedical EngineeringsynergyBlood Pressurecardiac neural controlYoung Adulthead-up tiltHeart RateHumansArterial PressureAnesthesiaPropofolAgedMultivariate autoregressive modelredundancyRespirationcerebrovascular autoregulationautonomic nervous systemheart rate variabilityMediationtransfer entropyHeartIndexesMiddle Agedsuppressiongeneral anesthesiapredictability decompositionconfoundingCerebrovascular CirculationSettore ING-INF/06 - Bioingegneria Elettronica e Informaticaautonomic nervous system; cardiac neural control; cerebrovascular autoregulation; confounding; general anesthesia; head-up tilt; heart rate variability; Multivariate autoregressive model; predictability decomposition; redundancy; suppression; synergy; transfer entropy;ProtocolsRegulation
researchProduct

Investigating cardiac and respiratory determinants of heart rate variability in an information-theoretic framework.

2014

This study was aimed at comparing two alternative information-theoretic approaches for the combined analysis of heart rate variability (HRV) and respiration variability (RV). The approaches decompose the predictive information about HRV in two terms, quantifying respectively the information stored into HRV and that transferred to HRV from RV. Storage and transfer were assessed by the popular self entropy (SE) and transfer entropy (TE) measures, as well as by the alternative conditional SE (cSE) and cross entropy (CE) measures. The comparison was performed at a theoretical level, computing the exact values of the four measures for simulated cardiorespiratory dynamics, and on real data, estim…

AdultMalemedicine.medical_specialtyEntropyHead-Down TiltElectrocardiographyRespiratory RateHeart RateInternal medicinemedicineEntropy (information theory)Heart rate variabilityHumansArrhythmia SinusRespiratory systemVagal tonePaced breathingMathematicsCardiorespiratory fitnessHealthy VolunteersCross entropySettore ING-INF/06 - Bioingegneria Elettronica E InformaticaCardiologyMedicineTransfer entropyFemaleAlgorithmsAnnual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
researchProduct